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MOVING PICTURE DECODING APPARATUS 
AND MOVING PICTURE DECODING METHOD 

BACKGROUND OF THE INVENTION 

The present invention relates to a moving picture decoding apparatus, and 
5 especially, to a moving picture decoding apparatus capable of reducing a necessary 
capacity of a frame memory to be used when coded moving pictures are decoded. 

Conventionally, this kind of a moving picture decoding apparatus is used in a 
method for reducing a necessary frame memory capacity used in the decoding 
process. As the conventional moving picture decoding apparatus, JP-A- 

10 261635/1997, for example, discloses an arrangement for reducing a frame memory 

capacity necessary for storage or reference images and re-ordering decoded images, 
which comprises a data compression circuit for compressing a decoded image and a 
data expansion circuit for expanding compressed data. Also, in JP-A-247673/1997, 
an arrangement is proposed in which a set of moving pictures data of which data 

1 5 content has been reduced by data content reducing means for reducing data content 

of data read from the frame memory is restored by data content restoring means. 

Also, in JP-A-4550/1998, for example, an apparatus is proposed in which a 
reduction in memory use capacity is facilitated using Adaptive Differential Pulse 
Code Modulation (ADPCM). In the apparatus described in the publication, 

20 compression is conducted by estimating a change in each block of 

n X m pixels compressed using orthogonal translation, encoding a first pixel of each 
block with p bits in accordance with the ADPCM method, encoding an estimated 
value of the change with n x h bits, and further, encoding a difference value between 
each pixel following the first pixel and an average value of all pixels in the block 

25 with p-k bits. 
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However, in the conventional moving picture decoding apparatus proposed in 
the above-described JP-A-4550/1998 and so forth, in which the objective is to reduce 
the capacity of frame memory used, there is a problem in that efficient access to the 
memory cannot be realized. 
5 The reason for this is that an access width of the memory is not taken into 

account in a memory compression and expansion section of the above-described 
moving picture decoding apparatus. 

SUMMARY OF THE INVENTION 

An objective of the present invention is to solve the above-mentioned 

10 problem. 

Also, another objective of the present invention is to provide a moving 
picture decoding apparatus for reducing the capacity of a frame memory necessary to 
be used when an image is decoded by a compression operation and accomplishing 
the compression and expansion processing of a memory content with high speed, and 

1 5 further, for decoding an image with high quality. 

To achieve the above-described objective, the moving picture decoding 
apparatus of the present invention, to which a compressed stream generated using an 
inter-frame prediction system is input, comprises compression means for 
compressing a decoded image when the signal is stored in a memory, expansion 

20 means for expanding a compressed image stored in the above-mentioned memory, 

quantization means for controlling quantization on compression in the above- 
described compression means, and access width control means for controlling the 
above-described quantization control means so that information content for a single 
or a plurality of memory compression processing units or for every control unit is a 

25 memory compression process is in conformity with the number of bits of an access 

unit of the above-mentioned memory. 
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In the moving picture decoding apparatus of the present invention, said access 
width control means comprises means for controlling said quantization control 
means so that the coded number of bits for a single or a plurality of compression 
processing units or for every control unit of compression processing is in conformity 
5 with the number of bits of an access unit of said storage means in the case that the 
coded number of bits exceeds the number of bits of an access unit of said storage 
means or is lacking. 

Furthermore, in the moving picture decoding apparatus of the present 
invention, said compression means and expansion means may conduct compression 
10 and expansion, respectively, in accordance with a pixel difference prediction 

encoding system. 

Furthermore, the moving picture decoding apparatus of the present invention 
may further comprise a plurality of quantizers and a plurality of quantization 
characteristic tables. 

1 5 Furthermore, the moving picture decoding apparatus of the present invention 

may further comprise a plurality of quantizers and a quantization characteristic table 

being shared by said plurality of quantizers. 

Furthermore, in the moving picture decoding apparatus of the present 

invention, said compression means and expansion means may conduct compression 
20 and expansion, respectively, in accordance with an orthogonal translation encoding 

system. 

Furthermore, in the moving picture decoding apparatus of the present 
invention, said access width control means preferably conducts control using 
information included in the compressed stream. 
25 Furthermore, in the moving picture decoding apparatus of the present 

invention, said storage means is preferably a frame memory. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects, feature and advantages of the present invention will 
become more apparent upon a reading of the following detailed description and 
drawings, in which: 

5 Fig. 1 is block diagram showing an arrangement of a moving picture 

decoding apparatus of the first preferred embodiment of the present invention; 

Fig. 2 is a diagram for explaining the principle of the present invention and 
for showing an access bit width and a width of an quantized data; 

Fig. 3 is a diagram for explaining the principle of the present invention and 
10 for showing an access bit width and a width of a quantized data; 

Fig. 4 is a block diagram for showing an arrangement of a memory 
compression and expansion section in the first embodiment of the present invention 
and 

Fig. 5 is a block diagram showing an arrangement of the second preferred 
1 5 embodiment of the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

An example of the present invention will be explained. In a moving picture 
decoding apparatus of the present invention, compression is applied to a decoded 
image in a memory compressor (105 of Fig. 1), and the compressed decoded image is 

20 stored in a frame memory (106 of Fig. 1). Based on the occupied content in the 

frame memory (106 of Fig. 1), in the case that the number of coded data bits for a 
single or a plurality of memory compression processing units or for every control 
unit of memory compression process exceeds the number of bits of a memory access 
unit or is lacking, a memory access width control section (110 of Fig. 1) applies 

25 control to a quantizer control section (109 of Fig. 1) so that the number of coded data 
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bits is conformed to be equal to or less than the number of bits of the memory access 
unit. 

First, the principle of the present invention will be explained. A decoded 
image is compressed using one of various compression methods. However, the 
number of coded data bits per compression processing unit is allocated during the 
compression operation based on compression ratio, and the number of bits of a 
memory access unit is not taken into account. 

It is assumed that the number of bits of the n^mory access unit is Ml bits, 
and the number of coded data bits of the compr^sion processing units, which are 
allocated based on a compression ratio, areXl, N2, N3, ... Nn, respectively, and Ml 
< Nl + N2 + ... Nn. In this case, coded^ta of n blocks cannot be extracted through 
one access. Accordingly, by decrea^g the number of bits allocated by Nl + N2 + ... 
Nn by Nl + N2 + ... Nn - Ml, a U^cated number of bits can be made equal to or less 
than Ml, an allocated bit caiyoe made equal to or less than Ml, and therefore, the 
coded data can be taken ojk through one access. 

An example of n = 3 as the n blocks is shown in Fig. 2. By subtracting more 
than or equal to M2 (M2 = (Nl + N2 + N3) -Ml) bits from Nl + N2 + N3 bits, an 
allocated number of bits can be made equal to or less than Ml. 

On the other hand, as shown in Fig. 3, in the case that the allocated number of 
bits is less than the number of bits Ml of a memory access unit, and a frame memory 
has enough capacity, allocation of the number of bits of the coded data can be also 
increased. 

In the present invention, on the basis of such principal, the memory access 
width control section (110 of Fig. 1) applies control of an access width of the frame 
memory to the quantization control section. 
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In the present invention, the memory compressor and memory expander may 
have an arrangement in v^hich compression and expansion are conducted, 
respectively, in accordance v^ith DPCM. 

In the present invention, based on access width information from the access 
5 v^idth control section, in the case that the generated information content for a single 

, or a plurality of memory compression processing units or for every control unit of a 

memory compression processing exceeds the number of bits of a memory access 
\^ unit, quantization control is conducted by preparing a plurality of quantizers having 
^ different quantization characteristics, and a quantization table, and by selecting a 
10 quantizer that is adapted to the access width. In this case, an arrangement may be 
adopted in which one quantization table is shared by the plurality of quantizers 
having different quantization characteristics. In other words, by variably changing a 
reference interval of one quantization table in accordance with an obtained 
quantization characteristic (resolution and so forth), it is possible to obtain the 
15 different quantization characteristics while one quantization table is shared. 

Also, in the present invention, the memory compressor and the memory 
expander may conduct compression and expansion, respectively, in accordance with 
an orthogonal translation encoding system. 

Moreover, in the present invention, the access width control section may 
20 apply access width control to the quantization control section using information 

included in the compressed stream. Below, a detailed explanation will be made in 
accordance with a preferred embodiment of the invention. 

A first preferred embodiment of the present invention will be explained in 
detail by referring to the drawings. Fig. 1 illustrates an arrangement of one 
25 embodiment of the present invention. 

Referring to Fig. 1 , this embodiment is constructed to include a variable 
length decoder 101, an inverse quantizer 102, an inverse discrete cosine transducer 
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(inverse DCT) 103, an adder 104, a motion compensation section 108, and a memory 
compression and expansion section 1 1 . The memory compression and expansion 
section 1 1 is constructed to include a memory compressor 105, a frame memory 106, 
a memory expander 107, a quantizer control section 109, and a memory width 
5 control section 110. 

A compressed moving pictures stream encoded by a system such as 
ISOIS 138 18-2 (MPEG-2 VIDEO) system is supplied as an input to the variable 
length decoder 101. 

The variable length decoder 101 performs variable length decoding, and 
10 supplies a result thereof to the inverse quantizer 102. 

The inverse quantizer 102 performs inverse quantization, and supplies a 
result thereof to the inverse discrete cosine transducer 103. 

The inverse discrete cosine transducer 103 transduces a conversion 
coefficient into an image, and supplies a result thereof to the adder 104. 
1 5 The adder 1 04 performs addition of the image supplied from the inverse 

discrete cosine transducer 103 and a predicted image supplied from the motion 
compensation section 108, and supplies a result thereof to the memory compression 
and expansion section 1 1 . 

The memory compression and expansion section 1 1 performs compression 
20 and expansion operations to a decoded image, and supplies it to the motion 

compensation section 108. 

The motion compensation section 108 performs motion compensation based 
on a motion vector supplied from the variable length decoder 101 and the image 
supplied from the memory compression and expansion section 1 1, and supplies the 
25 predicted image to the adder 104. 
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The memory compressor 105 of the memory compression and expansion 
section 1 1 applies compression to the image supphed from the adder 104, and stores 
the compressed result in the frame memory 106. 

The memory expander 107 extracts the compressed image from the frame 
memory 106 and expands it, and supplies the expanded result to the motion 
compensation section 108. 

The quantization control section 109 applies control of quantization of the 
image to the memory compressor 105 and the memory expander 107. 

The access width control section 110 applies control to the quantization 
control section 109 using information of the frame memory 106 so that the 
information content for a single or a plurality of memory compression processing 
units or for every control unit of the memory compression process is conformed to be 
equal to or less than the number of bits of a memory access unit. 

As the compression encoding method in the memory compressor and the 
memory expander, any of pixel difference encoding, adaptive pixel difference 
encoding, DCT translation, Hadamard translation, and Wavelet translation and so 
forth, for example, may be used. 

Fig. 4 illustrates an example of an arrangement of the memory compression 
and expansion section 1 1 according to the embodiment of the present invention 
discussed herein, in the case that the memory compressor 105 and the memory 
expander 107 operate according to the pixel difference encoding method. The 
memory compressor 105 and the memory expander 107 in Fig. 1 correspond to a 
memory compressor 21 and a memory expander 23 as shown in Fig. 4. 

Referring now to Fig. 4, the memory compressor 21 is constructed to include 
a subtracter 201, a quantizer 202, a fixed-length encoder 203, an inverse quantizer 
204, and adder 205, and a predictor 206. The memory expander 23 is constructed to 



include a fixed-length decoder 207, an inverse quantizer 208, an adder 209, and a 
predictor 210, 

An image to be compressed is supplied to the subtracter 201 as an input, and 
the subtracter 201 performs subtraction of this input signal and a predicted value 
supplied from the predictor 206, and supplies a prediction error to the quantizer 202. 

The quantizer 202 performs quantization of the prediction error in accordance 
with the quantization control section 24, and supplies the result to the fixed-length 
encoder 203 and the inverse quantizer 204. 

The fixed-length encoder 203 encodes the quantized value and stores it in the 
frame memory 22. In the inverse quantizer 204, the adder 205 and the predictor 206, 
inverse quantization and local decoding are performed, and an output from the 
predictor 206 is supplied to the subtracter 201 . 

The memory access w^idth control section 25 takes account of a compression 
ratio based on an occupied ratio of the frame memory 22, and applies bit allocation 
control to the quantization control section 24, which is in conformity with the 



number of bits of a memory access unit. 

The quantization control section 24 performs quantization control in which 
memory access width information is added, and applies control to the quantizer 202 
so that information content generated for a single or a plurality of memory 
compression processing units or for every control unit of the memory compression 
process is equal to or less than the number of bit of a memory access unit. 

In this embodiment, if the compression processing unit is assumed to be 
constant, a block of a single pixel or a plurality of m x n pixels defines the 
compression processing unit. 

The memory expander 23 receives a compressed image from the frame 
memory 22, and performs expansion of the compressed image by applying expansion 
and inverse quantization thereto, and outputs the resulting image. 
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Next, an example will be explained in which memory access width control is 
realized. One quantizer having a fixed compression ratio is used for quantization of 
a prediction error. As such, in the case that information content generated for a 
single or a plurality of memory compression processing units for every control unit 
of a memory compression process exceeds the number of bits of a memory access 
unit, a plurality of quantizers are prepared, and control is conducted so that the 
information content is in conformity with an access width. In this example, since an 
occupied content of the frame memory can be fixed, information from the frame 
memory is not required. In addition, an arrangement can be adopted in which a 
plurality of quantizers having quantization characteristics different from each other 
share one quantization characteristic table. 

On the other hand, in a case of orthogonal translation and so forth, it is 
different to fix the information content generated for a single or a plurality of 
memory compression processing units or for every control unit in a memory 
compression process. In such a case, use of an occupied content of the frame 
memory is convenient. 

Next, a second preferred embodiment of the present invention will be 
explained. In the above-described first embodiment, the access width control section 
110 conducts control of the quantizer control section 109 using the access memory 
width and the occupied content of the frame memory. 

Fig. 5 illustrates an arrangement of the second embodiment of the present 
invention. Referring to Fig. 5, in this embodiment, the access width control section 
110 receives information from the inverse quantizer 102, and applies control to the 
quantization control section 109, in which information included in a compressed 
stream is added, in other words, in which information during quantization is added. 
Accordingly, by taking account of the information of the compressed stream and a 



relationship between positions on an image, and so forth, allocation of the 
information content can be realized, which improves image quality. 

Using the present invention as explained above, several advantages are 
effected as described below. 

A first advantage of the present invention is that compression and expansion 
processing on the contents of the memory can be conducted with high speed. 

The reason for this effect is that, in the present invention, since quantization 
control is conducted on a number of bits which is equal to or less than the number of 
bits of a memory access unit, a number of access occurrences to the memory to 
extract the compressed image for expansion thereof is reduced. 

A second advantage of the present invention is that, by conducting allocation 
control of information content using the information included in the compressed 
stream, pixel error can be suppressed and image quality can be improved. 

The reason for this effect is that, in the present invention, by taking account 
of the information of the compressed stream and a relationship between positions on 
an image, and so forth, allocation of the information content can be realized, which 
improves image quality. 
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Amended 1 . A moving picture decoding apparatus to which/a compressed stream 
generated using an inter-frame prediction system is input, said apparatus comprising: 

compression means for compressing a decode^mnage and storing the resulting 
compressed image in storage means; 

expansion means for expanding a compn^sed image stored in said storage means; 

quantization control means for contr9}iing quantization on compression in said 
compression means; and 

access width control means fon/6ontrolling said quantization control means so that 
bit allocation control is conducted so as to Joe in conformity with the number of bits of an access 
unit of said storage means. 

Amended 2. A moving i^icture decoding apparatus according to claim 1, wherein said 
access width control means comprises means for controlling said quantization control means so 
that the number of coded bi^ of one or a plurality of compression processing blocks of image 
processed in said compre^ion means, or for every control unit of compression processing is in 
conformity with the number of bits of an access unit of said storage means in case that the coded 
number of bits exceeds the number of bits of an access unit of said storage means or is lacking. 



Amended 4. A moving picture decoding^pparatus according to claim 1, wherein said 
quantization control means controls quantization by preparing a plurality of quantizers and a 
plurality of quantization characteristic tabl^. 



Amended 5. A moving piouire decoding apparatus according to claim 1, wherein said 
quantization control means conteols quantization by preparing a plurality of quantizers and a 
quantization characteristic tabfe being shared by said plurality of quantizers. 
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.^AsiSH^ed 9. A moving picture decoding apparatus to which a compressed stream 
generated using an inter-frame prediction system is input, said apparatus comprising 
compression means for compressing a decoded image; 
storage means for storing a compressed image output from sai(Vcompression 




means; 



means; 



expansion means for expanding the compressed image storcd in said storage 



quantization control means for controUing quantization on compression in said 
compression means; and 

access width control means for applying bit allo6ation control to said quantization 
control means so as to be in conformity with the number of l/its of an access unit of said storage 
means, wherein 

said quantization control means control/quantization in said compression means 
based on access width information from said access/width control means so that generated 
information content for one or a plurality of concession processing blocks of the image 
processed in said compression means or for ev^ry control unit of compression processing is equal 
to or less than the number of bits of an acc)gJss unit of said storage means in the case that the 
generated information content exceeds the number of bits of an access unit of said storage means 
.^Lis^lacking. 




Amended 10. A movirfg picture decoding apparatus according to claim 9, wherein said 
access width control means^pplies bit allocation control to said quantization control means so as 
to be in conformity witMhe number of bits of an access unit of said storage means, based on an 
occupied content of §aid storage means. 

ended 12. A moving picture decodin^apparatus according to claim 9, wherein said 
access width control means applies control to j^id quantization control means so that, compared 
with the number of bits of an access unit ofi^aid storage means, in the case that the allocated 
number of bits of coded data of a comm?ession processing block exceeds the number of bits of 
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the access unit of said storage means or is less than the number of bits of me access unit of said 
storage means, the allocated number of bits is conformed to be equal tOyOr less than the number 
of bits of the access unit of said storage means by subtracting a predetermined number of bits 
from the allocated bits of coded data of said compression processins^block or by increasing the 
number of allocated bits by the predetermined number of bits, whereby the coded data is enabled 
to be extracted from said storage means with one access occurrence. 

Amended 13. A moving picture decoding apparatus Erccording to claim 9, wherein said 
compression means controls quantization characteristics us/d for quantizing said decoded image, 
based on control by said quantization control means. 

Amended 14. A moving picture decoding apparatus according to claim 9, wherein said 
quantization control means controls quantization bWpreparing a plurality of quantizers having 
quantization characteristics different from each otjler, and wherein a quantization characteristic 
table is shared by said plurality of quantizers. 



Amended 15. A moving picture decoding apparatus according to claim 9, wherein 

said compression means ccmiprises a subtracter, a quantizer, an encoder, an 
inverse quantizer, an adder and a predictor, 

a prediction error obtadned in said subtracter by a subtraction operation between 
said decoded image and a predicteca value from said predictor is supplied to said quantizer, 

under control of said quantization control means, said quantizer quantizes said 
prediction error and supplies tlae quantized result to said encoder and said inverse quantizer, 

said encoder /ncodes an output from said quantizer and outputs the encoded result 
to said storage means, anc 

inverse quantization and local decoding are conducted in said inverse 
quantization, said add|/r, and said predictor. 



Amended 17. A moving picture decoding method comprising the steps of: 



27043.1 



9 



detecting a number of coded bits for one or a jflurality of compression processing 
blocks of data or for every control unit of compression raocessing and controlling said number of 
coded bits so that said number of coded bits is in conformity with the number of bits of an access 
unit of a storage means when said detected nurnjsfer of coded bits exceeds the number of bits of 
an access unit of said storage means or is ia9ltmg. 



Amended 18. A moving pictjife of decoding method according to claim 1 7, wherein said 
step of controlling comprises using information from an external compressed data stream. 
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MOVING PICTURE DECODING APPARATUS 
AND MOVING PICTURE DECODING METHOD 



ABSTRACT 

A memory compression and expansion section (1 1 of Fig. 1) applies compression to a 
decoded image, and the result is stored in a frame memory. Based on an occupied content of the 




frame memory (Fig. 1 , 1 06), in case that the number of coded bits for a single or a plurality of 
memory compression processing blocks or for every control unit of memory compression 



processing exceeds the number of bits of a memory access unit or is lacking, a memory access 
width control section (110 of Fig. 1) applies control to a quantizer control section (109 of Fig. 1) 
so that the number of coded bits is conformed to be equal to or less than the number of bits of 
memory access unit. 
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